Understanding patient-reported outcome measures in Huntington disease: at what point is cognitive impairment related to poor measurement reliability?

PURPOSE: Symptom progression in Huntington disease (HD) is associated with cognitive decline which may interfere with the self-report of symptoms. Unfortunately, data to support or refute the psychometric reliability of patient-reported outcomes (PROs) as HD progresses are limited. This is problematic given that PROs are increasingly recognized as important measures of efficacy for new treatments. METHODS: We examined PRO data from the HDQLIFE Measurement System (Speech Difficulties; Swallowing Difficulties; Chorea) in 509 individuals with premanifest, early-stage, or late-stage HD. Clinician-administered assessments of motor functioning (items from the UHDRS) and standardized objective assessments of cognition (Stroop, Symbol Digit Modalities) were also collected. We examined item bias using differential item functioning (DIF) across HD stage (premanifest, early-, late-) and relative to cognitive performance. We also examined the correlations between self-report and clinician ratings. Regression models that considered total cognitive ability were utilized to determine psychometric reliability of the PROs. RESULTS: Most PRO items were free from DIF for both staging and cognition. There were modest correlations between PROs and clinician report (ranged from - 0.40 to - 0.60). Modeling analyses indicated that psychometric reliability breaks down with poorer cognition and more progressed disease stage; split-half reliability was compromised (i.e., split-half reliability < 0.80) when scores were < 136 for Chorea, < 109 for Speech Difficulties, and < 179 for Swallowing Difficulties. CONCLUSIONS: Results indicate that the psychometric reliability of PROs can be compromised as HD symptoms progress and cognition declines. Clinicians should consider PROs in conjunction with other types of assessments when total cognition scores exceed critical thresholds.

Validation of the NIH Toolbox in Individuals with Neurologic Disorders.

OBJECTIVE: Individuals with spinal cord injury (SCI), traumatic brain injury (TBI), and stroke experience a variety of neurologically related deficits across multiple domains of function. The NIH Toolbox for the Assessment of Neurological and Behavioral Function (NIHTB) examines motor, sensation, cognition, and emotional functioning. The purpose of this paper is to establish the validity of the NIHTB in individuals with neurologic conditions. METHODS: Community-dwelling individuals with SCI (n = 209), TBI (n = 184), or stroke (n = 211) completed the NIHTB. Relative risks for impaired performance were examined relative to a matched control groups. RESULTS: The largest group differences were observed on the Motor domain and for the Fluid Cognition measures. All groups were at increased risk for motor impairment relative to normative standards and matched controls. Fluid cognitive abilities varied across groups such that individuals with stroke and TBI performed more poorly than individuals with SCI; increased relative risks for impaired fluid cognition were seen for individuals in the stroke and TBI groups, but not for those in the SCI group. All three neurologic groups performed normally on most measures in the Sensation Battery, although TBI participants evidenced increased risk for impaired odor identification and the stroke group showed more vision difficulties. On the Emotion Battery, participants in all three groups showed comparably poor psychological well-being, social satisfaction, and self-efficacy, whereas the TBI group also evidenced slightly increased negative affect. CONCLUSIONS: Data provide support for the validity of the NIHTB in individuals with neurologic conditions.

Validation and clinical utility of the executive function performance test in persons with traumatic brain injury.

This study examined the relationships between the Executive Function Performance Test (EFPT), the NIH Toolbox Cognitive Function tests, and neuropsychological executive function measures in 182 persons with traumatic brain injury (TBI) and 46 controls to evaluate construct, discriminant, and predictive validity. Construct validity: There were moderate correlations between the EFPT and the NIH Toolbox Crystallized (r = -.479), Fluid Tests (r = -.420), and Total Composite Scores (r = -.496). Discriminant validity: Significant differences were found in the EFPT total and sequence scores across control, complicated mild/moderate, and severe TBI groups. We found differences in the organisation score between control and severe, and between mild and severe TBI groups. Both TBI groups had significantly lower scores in safety and judgement than controls. Compared to the controls, the severe TBI group demonstrated significantly lower performance on all instrumental activities of daily living (IADL) tasks. Compared to the mild TBI group, the controls performed better on the medication task, the severe TBI group performed worse in the cooking and telephone tasks. Predictive validity: The EFPT predicted the self-perception of independence measured by the TBI-QOL (beta = -0.49, p < .001) for the severe TBI group. Overall, these data support the validity of the EFPT for use in individuals with TBI.

HDQLIFE: development and assessment of health-related quality of life in Huntington disease (HD).

PURPOSE: Huntington disease (HD) is a chronic, debilitating genetic disease that affects physical, emotional, cognitive, and social health. Existing patient-reported outcomes (PROs) of health-related quality of life (HRQOL) used in HD are neither comprehensive, nor do they adequately account for clinically meaningful changes in function. While new PROs examining HRQOL (i.e., Neuro-QoL-Quality of Life in Neurological Disorders and PROMIS-Patient-Reported Outcomes Measurement Information System) offer solutions to many of these shortcomings, they do not include HD-specific content, nor have they been validated in HD. HDQLIFE addresses this by validating 12 PROMIS/Neuro-QoL domains in individuals with HD and by using established PROMIS methodology to develop new, HD-specific content. METHODS: New item pools were developed using cognitive debriefing with individuals with HD, and expert, literacy, and translatability reviews. Existing item banks and new item pools were field tested in 536 individuals with prodromal, early-, or late-stage HD. RESULTS: Moderate to strong relationships between Neuro-QoL/PROMIS measures and generic self-report measures of HRQOL, and moderate relationships between Neuro-QoL/PROMIS and clinician-rated measures of similar constructs supported the validity of Neuro-QoL/PROMIS in individuals with HD. Exploratory and confirmatory factor analysis, item response theory, and differential item functioning analyses were utilized to develop new item banks for Chorea, Speech Difficulties, Swallowing Difficulties, and Concern with Death and Dying, with corresponding six-item short forms. A four-item short form was developed for Meaning and Purpose. CONCLUSIONS: HDQLIFE encompasses both validated Neuro-QoL/PROMIS measures, as well as five new scales in order to provide a comprehensive assessment of HRQOL in HD.

New measures to capture end of life concerns in Huntington disease: Meaning and Purpose and Concern with Death and Dying from HDQLIFE (a patient-reported outcomes measurement system).

PURPOSE: Huntington disease (HD) is an incurable terminal disease. Thus, end of life (EOL) concerns are common in these individuals. A quantitative measure of EOL concerns in HD would enable a better understanding of how these concerns impact health-related quality of life. Therefore, we developed new measures of EOL for use in HD. METHODS: An EOL item pool of 45 items was field tested in 507 individuals with prodromal or manifest HD. Exploratory and confirmatory factor analyses (EFA and CFA, respectively) were conducted to establish unidimensional item pools. Item response theory (IRT) and differential item functioning analyses were applied to the identified unidimensional item pools to select the final items. RESULTS: EFA and CFA supported two separate unidimensional sets of items: Concern with Death and Dying (16 items), and Meaning and Purpose (14 items). IRT and DIF supported the retention of 12 Concern with Death and Dying items and 4 Meaning and Purpose items. IRT data supported the development of both a computer adaptive test (CAT) and a 6-item, static short form for Concern with Death and Dying. CONCLUSION: The HDQLIFE Concern with Death and Dying CAT and corresponding 6-item short form, and the 4-item calibrated HDQLIFE Meaning and Purpose scale demonstrate excellent psychometric properties. These new measures have the potential to provide clinically meaningful information about end-of-life preferences and concerns to clinicians and researchers working with individuals with HD. In addition, these measures may also be relevant and useful for other terminal conditions.

The development of a new computer adaptive test to evaluate chorea in Huntington disease: HDQLIFE Chorea.

PURPOSE: Huntington's disease (HD) is an autosomal dominant neurodegenerative disease associated with motor, behavioral, and cognitive deficits. The hallmark symptom of HD, chorea, is often the focus of HD clinical trials. Unfortunately, there are no self-reported measures of chorea. To address this shortcoming, we developed a new measure of chorea for use in HD, HDQLIFE Chorea. METHODS: Qualitative data and literature reviews were conducted to develop an initial item pool of 141 chorea items. An iterative process, including cognitive interviews, expert review, translatability review, and literacy review, was used to refine this item pool to 64 items. These 64 items were field tested in 507 individuals with prodromal and/or manifest HD. Exploratory and confirmatory factor analyses (EFA and CFA, respectively) were conducted to identify a unidimensional set of items. Then, an item response theory graded response model (GRM) and differential item functioning analyses were conducted to select the final items for inclusion in this measure. RESULTS: EFA and CFA supported the retention of 34 chorea items. GRM and DIF supported the retention of all of these items in the final measure. GRM calibration data were used to inform the selection of a 6-item, static short form and to program the HDQLIFE Chorea computer adaptive test (CAT). CAT simulation analyses indicated a 0.99 correlation between the CAT scores and the full item bank. CONCLUSIONS: The new HDQLIFE Chorea CAT and corresponding 6-item short form were developed using established rigorous measurement development standards; this is the first self-reported measure developed to evaluate the impact of chorea on HRQOL in HD. This development work indicates that these measures have strong psychometric properties; future work is needed to establish test-retest reliability and responsiveness to change.

HDQLIFE: the development of two new computer adaptive tests for use in Huntington disease, Speech Difficulties, and Swallowing Difficulties.

PURPOSE: Huntington disease (HD) is an autosomal dominant neurodegenerative disease which results in several progressive symptoms, including bulbar dysfunction (i.e., speech and swallowing difficulties). Although difficulties in speech and swallowing in HD have a negative impact on health-related quality of life, no patient-reported outcome measure exists to capture these difficulties that are specific to HD. Thus, we developed a new patient-reported outcome measure for use in the Huntington Disease Health-Related Quality of Life (HDQLIFE) Measurement System that focused on the impact that difficulties with speech and swallowing have on HRQOL in HD. METHODS: Five hundred and seven individuals with prodromal and/or manifest HD completed 47 newly developed items examining speech and swallowing difficulties. Unidimensional item pools were identified using exploratory factor analysis and confirmatory factor analysis (EFA and CFA, respectively). Item response theory (IRT) was used to calibrate the final measures. RESULTS: EFA and CFA identified two separate unidimensional sets of items: Speech Difficulties (27 items) and Swallowing Difficulties (16 items). Items were calibrated separately for these two measures and resulted in item banks that can be administered as computer adaptive tests (CATs) and/or 6-item, static short forms. Reliability of both of these measures was supported through high correlations between the simulated CAT scores and the full item bank. CONCLUSIONS: CATs and 6-item calibrated short forms were developed for HDQLIFE Speech Difficulties and HDQLIFE Swallowing Difficulties. These measures both demonstrate excellent psychometric properties and may have clinical utility in other populations where speech and swallowing difficulties are prevalent.